Activity-dependent stochastic resonance in recurrent neuronal networks 
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We use a biophysical model of a local neuronal circuit to study the implications of synaptic plas- 
ticity for the detection of weak sensory stimuli. Networks with fast plastic coupling show behavior 
consistent with stochastic resonance. Addition of an additional slow coupling that accounts for the 
asynchronous release of neurotransmitter results in qualitatively different properties of signal de- 
tection, and also leads to the appearance of transient post-stimulus bistability. Our results suggest 
testable hypothesis with regard to the self-organization and dynamics of local neuronal circuits. 

PACS numbers: Valid PACS appear here 



Stochastic resonance (SR) refers to the condition in 
which noise and nonlinearity combine together to amplify 
otherwise undetectable stimuli This simple, yet im- 
portant, phenomenon, has received much attention due 
to its apparent ubiquity in many nonlinear abiotic [l| 
and biological 0] systems. In particular, a number of 
studies have raised the possibility that neurons [H, 0] and 
neuronal cell assemblies [B[ might utilize SR in order to 
detect weak sensory stimuli Q. 

For these studies, the noise felt by individual neurons 
has been assumed to arise from the random summation 
of a large number of synaptic stimuli 0, @|. There is 
however another important source of noise, that of the 
stochastic nature of synaptic transmission. In particu- 
lar, there can occur spontaneous asynchronous release 
(AR) of neurotransmitter at a rate that is strongly depen- 
dent on the pre-synaptic Ca 2+ concentration and hence 
strongly dependent on the rate of spike-induced Ca 2+ in- 
take [7(. Since a high probability of release can last for 
> 0.1 sec, AR constitutes a challenging example of slow 
time-scale, activity-dependent noise. 

The purpose of this work is to show that SR for lo- 
cal circuits consisting of roughly 100 neurons (a "micro- 
column" [§]) coupled via noisy plastic synapses takes a 
dramatically different form from that seen in investiga- 
tions to date. As we will see, the coherence of the re- 
sponse continues to depend non-trivially on the coupling 
strength and the assembly size. Furthermore, the cir- 
cuit can exhibit short-term memory, by which we mean 
that spiking will continue to occur for a transient pe- 
riod following removal of the stimulus. These results can 
be directly tested in experiments on cultured networks 
0, 0| and offer some new insights into the way neuronal 
systems can be organized for optimal information pro- 
cessing. From the dynamical systems point of view, this 
work represents a new example of how SR phenomenol- 
ogy can depend on the specific type of noise; this has 
been considered in only a few examples to date 

To proceed, we use a network model that has recently 
been developed to account for the occurrence of rhythmic 
reverberatory responses in hippocampal cultures 0, E| • 
The neurons in the network obey Morris-Lecar like dy- 



namics [12j | with the membrane voltage given by 
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In eqnJTJ the ionic current Iu 
tion from membrane channels 



i lon describes the contribu- 
The term Ib g is a 
background current that represents summation of a large 
number of synaptic stimuli from neurons that are not 
part of the specific local circuit. Rather than explicitly 
modeling a very large network and imposing a connec- 
tivity pattern which embodies the local circuit notion, 
we instead include these neurons implicitly by assum- 
ing (as in ,6:]) that their contribution is described by 
a Langevin equation I bg = —Ib g /T n + y/D/r n M(0, 1), 
with r n = 10 msec and W(0, 1) being uncorrelated Gaus- 
sian noise with zero mean and unitary variance. The 
synaptic current due to the local circuit is modeled as 
jsyn = _^g Yij (t)V u with g G [0.5,0.8] mS/cm 2 being 
the maximal value of synaptic conductance, the sum run- 
ning over the set of input channels, and the term Yg as 
described below. With the parameters as given in [13 ] . 
the transition from quiescence to regular spiking occurs 
through a Hopf bifurcation. 

To capture the dynamical aspects of synaptic cou- 
pling, we assume that at any time, presynaptic resources 
can be in a recovered state (described by the state vari- 
able X in equations below) , in an active state (described 
by the state variable Y), or in an inactive state (described 
as .£ = 1 — X — Y) pj] . The dynamics for the j — > i 
presynaptic terminal are 
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At each presynaptic terminal of the i-th neuron, the 
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fraction of active resources (ly) experiences a brief in- 
crease of magnitude UX^j when, at time t 3 s , an action 
potential from j-th neuron invades the presynaptic ter- 
minal. Alternatively, a relatively small amount of re- 
source can be maintained in an active state by the asyn- 
chronous release of synaptic resource that occurs at times 
P a with Ca 2+ -dependent rate 77(c) and amplitude £. The 
rate of asynchronous release (probability to observe an 
event during the interval [t a , t a + dt], modeled as Poisson 
process) is taken to be a Hill function of the presynap- 
tic residual Ca 2+ concentration, c [ll|, EH • This resid- 
ual Ca 2+ accumulates at presynaptic terminals in an 
activity-dependent way that is proportional to electro- 
chemical gradient across the membrane, and is extruded 
into the extra-cellular space by a non-linear pump. The 
term I p ensures that the minimal Ca 2+ concentration is 
ps 60 nM. Parameters are given in [16| . Note that the 
phasic (UXij) and asynchronous (£Ay) terms are both 
proportional to the amount of available resource, Xy, un- 
derscoring the activity-dependent competition between 
these two different coupling modes [l7j |. 

To assess the extent to which an individual neuron 
and/or a network can exhibit coherent activity, we use 
the coherence of spiking (COS) measure 0, Given 
a weak external sub-threshold stimulation of period T, 
Istimit) = l^^ s * n (27r^), the COS measure is defined 
here as Cs = jV ( - 9T ^:-^^<~ 1 - 1T ) ; that is, the fraction of 
inter-spike-intervals (ISIs) that are within 20% of stim- 
ulus period, T — 0.1 sec. All results, unless otherwise 
indicated, are for a network of N — 100 neurons that 
have probability p = 0.1 to establish connections with 
their peers. 

We first analyze the response of an uncoupled neuronal 
network to weak sub-threshold periodic stimulation and 
different (controlled) intensities of synaptic background 
noise, Ib g . In agreement with previous studies [3(, we 
find that there exists an optimal level of noise for which 
a model neuron exhibits a maximal coherence of spiking 
(FigQJ\., dashed line). Coupling the model neurons by 
activity-dependent synapses (as in eqs. [2|) while setting 
Vmax = (no asynchronous release) moves the resonant 
peak towards lower noise intensities. As FigfT]A_ (insets) 
shows, the location and the height of the new peak is 
largely independent of the coupling parameter, U. This 
observation is consistent with the notion of efficient signal 
propagation on random graphs - once U is above critical 
coupling threshold, an SR-like activation of one neuron 
will quickly spread the word to other neurons, regardless 
of the exact value of U. 

Introduction of activity-dependent asynchronous re- 
lease of neurotransmitter results in a qualitatively dif- 
ferent picture. The coherence measure as a function of 
evoked and asynchronous release is shown in Fig[2]A.. It 
is clear that the spiking coherence increases significantly 
for higher values of the resource utilization parameter 
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FIG. 1: Stochastic resonance in dynamically coupled 
neuronal networks. A) An uncoupled cell ensemble ex- 
hibits a broad-peak stochastic resonance with relatively weak 
coherence of spiking (dashed line). Introduction of dynamic 
coupling enables the efficient exchange of stimulus-related in- 
formation, and moves the resonance peak to lower noise in- 
tensities. Once above a minimal coupling threshold, different 
coupling strengths induce nearly the same coherence-noise 
curves (superimposed lines). Both optimal noise intensity 
(top inset) and peak coherence (bottom inset) are nearly inde- 
pendent of synaptic coupling. B) Sample neuronal membrane 
voltage for D = 1.25 • 10~ 2 , U = 0.4, r) max = 0. 

U . The optimal level of AR needed to produce maximal 
coherence (peaks in Fig[5]A) also depends on the value 
of U . Stronger evoked transmission will quickly deplete 
the available resources; therefore, since asynchronous and 
evoked releases draw from the same pool of vesicles, 
higher rate of spontaneous events is needed to achieve 
significant spiking coherence (top inset of FigO^-). For 
higher values of rj ma x , when the combined action of AR 
and Ibg masks the stimulus by making the cell spike more 
frequently, the coherence measure converges to low val- 
ues. On the other hand, strong coupling and fast deple- 
tion of resources provide a constraint for spiking activity, 
resulting in higher overall coherence for higher resource 
usage (bottom inset of Fig[2K)- 

The distinctive effect of AR (as compared with Ib g ) is 
further assessed by analyzing the collective dynamics for 
high rj max (vs. high D). Subjecting the network to high- 
intensity dynamics-independent noise (Fig[3JA) results in 
high-rate, weakly correlated, activity. On the other hand, 
as FigJ3j3 shows, the combined action of strong AR and 
synaptic depression significantly sharpens the network's 
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response to the stimulus. Further, the prolonged time- 
scale of AR enables the network to "remember" the stim- 
ulus seconds after its cessation (Fig|3C). 

The observation that coherence of spiking depends on 
the strength of dynamic coupling prompted us to explore 
how networks' parameters affect its ability to detect weak 
stimuli. To this end, we considered the performance of 
different size networks, for a range of AR rates. For eas- 
ier interpretation of results, we assume here that, for all 
cases, U = 0.3. FigurelU'V shows that the profiles of COS 
curves are different for different network sizes. Due to 
the p = const constraint, neurons in larger networks are 
subject to higher levels of asynchronous release in their 
inputs; as a result, the resonant peak moves toward lower 
values of rj max . Conversely, fixing the value of rjmax and 
plotting the COS measure as a function of network size 
(as is in Figf4j3) reveals that the optimal network size 
(giving maximal coherence) depends on the level of AR 
at individual model synapses. Thus, in a network with 
plastic coupling, synaptic parameters might provide con- 
straints for the sizes of cell assembly. 

Stochastic resonance relies on the cooperativity be- 
tween noise, nonlinearity and a weak sub-threshold stim- 
ulus [H- In most examples, the noise is taken to be inde- 
pendent of the characteristics of the weak sub-threshold 
stimulus (but see [13]). Here, we have investigated the 
properties of signal processing in local recurrent neuronal 
networks with plastic coupling and asynchronous release 
of neurotransmitter, where the noise is inherently coupled 
to the signal. We found that in plastic networks without 
AR, the characteristics of stochastic resonance (location 
and height of peak coherence) only weakly depend on the 
strength of synaptic coupling. On the contrary, introduc- 
tion of AR leads to a strong dependence of SR properties 
on network parameters. 

These observations suggest that asynchronous release 
of neurotransmitter might play an important role in neu- 
ronal dynamics [l9j . Information that is contained in 
weak signals should not only be detected and amplified 
by brain circuitry; a network has to have the ability to 
transiently "hold" knowledge about preceding events. As 
shown in 0, a brief stimulus delivered to the net- 
work evokes reverberatory activity that is sustained by 
the asynchronous release of neurotransmitter and lasts 
for several seconds. Our results (Fig[3p) together with 
experimental observations [3] and prior modeling 11 1. 
suggest that AR can be instrumental in detection, am- 
plification, and transient holding of weak sensory stimuli. 

This study leads to several potentially interesting con- 
clusions. First, we showed here that the ability of a 
neuron (that is embedded in a neuronal network) to de- 
tect and amplify weak stimuli might crucially depend on 
the form of feedback from the network, and in particu- 
lar on the plasticity features of the effective connectiv- 
ity. Second, our results suggest that the plasticity of 
synaptic connections might provide an important con- 
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FIG. 2: Stochastic resonance in a network with asyn- 
chronous release of transmitter. A) When a slow asyn- 
chronous mode of synaptic transmission is introduced in addi- 
tion to the fast phasic coupling, the extent of output spiking 
coherence depends on the strength of the phasic coupling (U). 
For clarity of presentation, only the cases U = 0.1 , 0.3, 0.5, 0.7 
are shown. Both the location (top inset) and magnitude (bot- 
tom inset) of the coherence peak are positively correlated with 
the strength of evoked synaptic transmission, underscoring 
the fact that both kinds of synaptic transmission share the 
same pool of synaptic resources. B) Sample neuronal mem- 
brane voltage for rj max = 0.28, U = 0.4, D = 0.64 ■ f0~ 2 . 



straint for the optimal number of neurons in a local cir- 
cuit. With this perspective, the local network with strong 
inter-connectivity is optimized for signal detection, with 
distant neurons providing contextual information in the 
form of an overall background noise signal. Cultured net- 
works can provide an adequate framework to test the va- 
lidity of our conclusions. State of the art techniques allow 
one to grow small networks of controlled size, geometry 
and connectivity [3]. Future experiments will determine 
how these parameters affect the ability of a network to 
process weak stimuli. 

We thank W.J. Rappel and T.J. Sejnowski for stim- 
ulating discussions. This research has been supported 
by the NSF-sponsored Center for Theoretical Biological 
Physics (grant nos. PHY-0216576 and PHY-0225630). 
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FIG. 3: AR induces correlated collective dynamics. 

Raster plots show the firing activity of a neuronal network 
with U = 0.4. A) A network with D = 7.84 ■ W~ 2 ,ri max = 
exhibits high-rate, uncorrelated activity. On the contrary, 
a network with D = 0, r/ max = 0.8 (B) exhibits burst-like, 
correlated collective activity. C) A network driven by AR 
shows transient bi-stability in its activity (top panel) that 
persists for seconds after stimulus removal (bottom panel). 
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